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FOREWORD 


This  report  was  prepared  by  the  Human  Engineering  Branch  of  the  Behavioral  Sciences 
Laboratory,  6570th  Aerospace  Medical  Research  Laboratories,  Aerospace  Medical  Division, 
Wright- Patterson  Air  Force  Base,  Ohio.  The  work  was  performed  under  Project  7184,  "Human 
Performance  in  Advanced  Systems,  "  Task  718405,  "Weapon  System  Design  Criteria.  "  The  author 
is  grateful  for  the  helpful  comments  of  Mr.  Charles  Bates  and  the  assistance  of  Mr.  James 
Campbell  in  setting  up  and  maintaining  the  apparatus.  Particular  thanks  are  due  to  Mr.  Michael 
Nemeroff  who  ran  all  subjects  for  this  experiment.  This  investigation  was  carried  out  at  the 
Engineering  Psychology  Research  Project  of  Antioch  College  under  Contract  AF  33(616)-6095. 

This  study  was  completed  in  September  1962. 


ABSTRACT 


This  study  was  undertaken  to  verify  the  "optimum”  control  dynamics  reported  in  WADC 
TR  59-712  and  to  lend  experimental  validation  to  the  method  in  which  they  were  derived.  A  simple 
two  group  experiment  was  performed  to  compare  tracking  performance  on  a  single  axis  tracking 
task  using  the  "optimum"  dynamics  with  tracking  performance  using  a  simple  integrator  (rate 
control).  No  significant  difference  was  found  in  either  learning  rate  or  in  tracking  ability  after  the 
task  was  learned.  A  second  experiment  using  the  same  experimental  design  requiring  two-axis 
tracking  was  conducted  to  test  the  hypothesis  that  differences  would  appear  only  when  the  subjects 
were  more  heavily  task-loaded.  The  "optimum"  dynamics  produced  reliably  better  performance 
than  the  rate  control  in  the  two-axis  task.  This  result  supplied  experimental  validation  for  the 
predictions  made  using  the  human  transfer  and  reported  in  WADC  TR  59-712. 


PUBLICATION  REVIEW 


This  technical  documentary  report  has  been  reviewed  and  is  approved. 


WALTER  F.  GRETHER 
Technical  Director 
Behavioral  Sciences  Laboratory 
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A  COMPARISON  BETWEEN  TRACKING  WITH  "OPTIMUM"  DYNAMICS 
AND  TRACKING  WITH  A  SIMPLE  VELOCITY  CONTROL 


INTRODUCTION 


During  the  past  10  years,  Aeronautical  Systems  Division  and  this  laboratory  have  had  a 
continuing  effort  to  determine  the  mathematical  describing  function  of  the  pilot  in  a  closed-loop 
tracking  situation.  The  results  of  this  work  have  been  published  in  a  number  of  WADC  and  ASD 
Technical  Reports.  Much  of  this  work  is  summarized  in  the  Dynamic  Response  of  Human 
Operators  (ref.  2).  That  report  puts  the  work  of  previous  investigators  into  the  same  format,  but 
it  does  not  generalize  the  information  to  a  form  readily  usable  by  the  design  engineer.  A  Survey 
of  Human  Dynamic  s  Data  and  a  Sample  Application  (ref.  4)  attempts  to  show  the  applicative  and 
limitations  of  the  human  describing  function.  In  that  report  the  "optimum"*  transfer  function  for 
an  aircraft  was  developed  on  a  theoretical  basis.  This  transfer  function  was  of  the  form 
K(Ti  S  +  1)^  „ 

S (Ta S  +  1)  •  constants  (Tjand  Tg)  were  such  that  the  lead  and  lag  terms  had  very  little 

effect  in  the  frequency  region  normally  associated  with  manual  tracking.  The  function  thus 
approximates  K  or  a  simple  velocity  control,  as  may  be  seen  from  the  Bode  Plots  in  the  appendix. 

S 


The  purpose  of  the  sxpei-iments  described  in  this  report  was  to  determine  whether  there  was  any 
significant  difference  between  tracking  performance  with  the  optimum  dynamics  and  tracking 
performance  with  the  simple  velocity  control. 


EXPERIMENT  NO.  I 


The  first  experiment  was  conducted  with  a  simple  single-axis  compensatory  tracking  task. 
The  subjects  were  instructed  to  maintain  a  horizontal  line  in  the  center  of  an  oscilloscope  face  by 
fore-aft  movement  of  a  floor  mounted  aircraft-type  control  stick  located  directly  in  front  of  them. 


♦The  parameter  values  were  optimum  in  terms  of  rms  error  criterion  for  the  transfer  function 
assumed  for  study. 
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Simulation  Apparatus 


The  experimental  apparatus  employed  in  this  first  study  consisted  of  an  analog  computer 
mechanization  of  the  transfer  functions,  an  oscilloscope  to  simulate  the  artificial  horizon,  and 
four  sinewave  oscillators  to  produce  the  forcing  function.  The  apparatus  was  arranged  as  shown 
in  figure  1.  The  subject  was  seated  in  the  room  on  the  left  in  a  long-range  aircraft  seat.  The  CRT 
display  was  approximately  18  inches  directly  in  front  of  the  subject  with  the  center  of  the  display 
approximately  15  degrees  below  eyelevel.  Above  the  display  was  a  warning  light  that  came  on 
before  the  start  of  each  run.  Above  the  light  was  a  meter  on  which  the  subject's  score  was  displayed 
after  the  end  of  each  run.  The  subject's  control  was  an  undamped  aircraft- type  control  stick 
located  between  his  legs  approximately  8  inches  in  front  of  the  seat.  The  experimenter  was  able  to 
keep  a  constant  check  on  the  subject  through  the  one-way  glass  located  to  the  subject's  right. 


Figure  i.  Experimental  Situation 


Measuring  Apparatus 

The  score  in  this  experiment  was  the  integral  of  the  absolute  tracking  error.  The  circuit  for 
obtaining  this  score  is  shown  in  figure  2.  The  scoring  interval  was  55  seconds.  Scoring  started 
5  seconds  after  the  start  of  the  tracking  run  to  allow  the  subject  to  lock-on  to  the  display. 
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Figure  2. 


Scoring  Circuit 


/or /lEldt 


Experimental  Task 


The  task  in  this  experiment  was  to  maintain  the  horizon  line— the  scope  horizontal  sweep 
— in  the  center  of  the  screen.  An  edge-lighted  grid  over  the  screen  provided  a  reference  frame. 
This  was  intended  to  correspond  to  maintaining  an  aircraft  in  level  flight.  The  disturbing  force 
was  the  sum  of  four  sinewaves  whose  amplitudes  varied  inversely  with  their  frequency  (as  indicated 
in  table  1).  Since  the  frequency  components  were  nonharmonically  related,  the  resultant  sum 
appeared  to  be  random. 


TABLE  I 

FORCING  FUNCTION  SPECTRUM 


Frequency 

Amplitude 

0. 11  cps 

10. 0  rms  volts 

0.  23  cps 

4.  5  rms  volts 

0.  48  cps 

2.  3  rms  volts 

1. 00  cps 

1. 1  rms  volts 

Subjects 

Two  groups  of  subi®cts  were  tested,  one  group  on  each  set  of  dynamics.  There  were  12  male 
college  students  in  one  group  and  11  in  the  other.  The  subjects  were  randomly  assigned  to  the 
two  groups  in  order  of  appearance.  None  of  the  subjects  had  any  prior  experience.  Each  subject 
was  run  through  21  trials  per  day  for  3  consecutive  days.  Each  trial  was  of  1-minute  duration 
with  a  1-minute  rest  between  trials.  A  3-minute  break  was  given  after  each  group  of  three  trials. 
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Results 


The  median  scores  for  all  subjects  are  shown  in  figure  3.  The  scores  for  the  last  12  trials 
only  were  considered  in  the  analysis.  A  mean  for  each  subject  in  each  group  was  obtained  and  the 
two  groups  compared  with  a  simple  t-test.  No  significant  difference  at  the  .  05  level  was  found, 
however,  as  shown  in  figure  3,  the  performance  over  the  last  12  trials  was  consistently  better 
using  the  optimum  dynamics. 

The  suitability  of  the  t-test  for  these  data  can  be  questioned.  For  this  reason,  the  median 
scores  for  each  subject  in  both  groups  were  determined  and  the  median  test  was  applied  to  these 
scores.  Again,  the  difference  was  not  significant  at  the  .05  level.  The  exact  probability  by  Fisher's 
method  was  0. 1504. 

Figure  3  suggested  a  possibility  of  difference  in  the  learning  rate  between  the  two  groups.  To 
determine  whether  there  was  such  a  difference,  an  analysis  of  variance  was  run  on  the  data  from 
the  first  18  trials.  To  simplify  the  analysis  each  group  of  three  trials  was  first  averaged  and 
these  averaged  scores  used  in  the  analysis.  The  results  of  this  analysis  are  shown  in  the  appendix. 
There  was  no  significant  difference  in  the  learning  rates. 

Discussion  of  Experiment  No.  I 

There  are  several  possible  explanations  for  the  failure  of  this  experiment  to  reveal  a 
statistically  significant  superiority  of  the  optimum  dynamics  as  would  be  predicted  in  the  Survey  of 
Human  Dynamic  s  Data  and  a  Sample  Application  (ref.  4).  One  possibility  is  the  difference  in  methods  of 
scoring  the  system  performance.  In  the  development  of  the  optimum  dynamics  the  criterion  used 
was  minimum  rms  error.  In  this  experiment  the  criterion  used  was  integrated  absolute  error 
(/IE  I  dt).  Fitts*  states  that  for  large  samples  of  normal  distributions  the  average  deviation  and 
the  standard  deviation  are  related  by  a  constant  (AD  =  0. 7979  SD).  Since  the  rms  error  score  is 
the  standard  deviation  of  the  error  signal  about  zero  and  the  J  |  E  |  dt  score  is  the  average  deviation 
times  a  constant  (run  length),  the  difference  in  scoring  systems  is  probably  not  the  cause  of  the 
difference. 

Another  possible  source  of  the  difference  lies  in  the  nature  of  the  forcing  function  used. 

This  is  probably  not  a  valid  source  since  the  forcing  function  used  in  this  experiment  contained 
more  power  at  the  high  frequencies  than  did  the  forcing  function  used  in  the  derivation  of  the 
optimum  dynamics.  This  is  shown  in  figure  4.  The  broken  line  represents  the  output  of  a  white 
noise  source  passed  through  a  third-order  binomial  filter  with  a  break  frequency  at  1  radian  per 
second.  This  is  the  forcing  function  used  in  the  derivation  of  the  optimum  dynamics.  The  vertical 
bars  represent  the  frequency  components  used  in  this  experiment.  Since  the  Bode  plots  (seefigure  7, 
appendix)  of  the  two  sets  of  dynamics  tested  are  nearly  identical  up  to  1  radian  per  second,  the 
spectrum  used  in  this  experiment  would  be  more  likely  to  show  the  differences  in  the  two  sets  of 
dynamics  than  the  one  used  in  the  original  derivation. 

Another  possibility  is  that  the  subjects  were  not  heavily  task  loaded.  That  is,  the  task  may 
have  been  so  easy  that  the  subjects  could  easily  compensate  for  the  nonoptimum  dynamics.  To  test 
this  hypothesis  a  second  experiment  was  conducted. 


♦Fitts,  P.  M. ,  et  al. ,  Skilled  Performance,  Final  report  under  Wright  Air  Development  Center 
Contract  AF  41(657)-70,  March  1959. 
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Figure  3.  Median  Integrated  Error  ys  Run  Number 
Experiment  1 
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EXPERIMENT  NO.  II 


The  second  experiment  was  conducted  using  a  two-axis  compensatory  tracking  task.  The 
subjects  were  instructed  to  maintain  a  spot  in  the  center  of  an  oscilloscope  face  by  fore-aft  and 
left-right  manipulation  of  an  aircraft-type  control  stick  mounted  directly  in  front  of  them. 

Simulation  Apparatus 


The  experimental  apparatus  used  in  this  second  experiment  was  identical  to  that  used  in  the 
first  experiment  with  the  following  exceptions; 

1.  Two  white  noise  generators  with  third-order  binomial  filters  cut-off  at  1  radian  per 
second  were  used  to  provide  two  independent  forcing  functions. 

2.  The  display  was  a  spot  on  the  CRT  that  could  translate  both  vertically  and  horizontally. 

3.  The  control  stick  was  free  to  move  in  two  axes  rather  than  one. 

4.  The  computer  was  programmed  to  provide  identical  dynamics  in  two  axes.  Either  the 
optimum  or  the  simple  integrator  dynamics  were  used  for  both  horizontal  and  vertical  display 
axes.  ♦ 

5.  The  scoring  circuit  was  made  less  sensitive  to  accommodate  the  more  difficult  task. 

6.  Two  meters  were  mounted  on  the  subject's  panel  to  read  out  his  scores  on  each  axis 
independently  after  the  end  of  each  run. 

Experimental  Task 

The  task  in  the  second  experiment  was  to  keep  a  dot  centered  on  the  CRT.  An  edge-lighted 
grid  was  provided  over  the  CRT  face.  The  situation  was  roughly  analogous  to  flying  a  tail-chase 
mission  in  an  aircraft.  The  forcing  functions  in  this  experiment  were  filtered  white  noise  with  a 
third-order  filter  cut-off  at  1  radian  per  second. 

Subjects 

Two  groups  of  subjects  were  tested,  one  on  each  set  of  dynamics.  There  were  13  male 
college  students  in  each  group.  The  subjects  were  randomly  assigned  to  the  two  groups  in  order  of 
appearance.  The  subjects  did  not  have  any  prior  experience.  Each  of  the  subjects  was  run  through 
21  trials  per  day  for  4-consecutive  days.  Each  trial  was  of  1-minute  duration  with  a  1-minute 
rest  between  trials.  A  3-minute  break  was  given  after  each  group  of  three  trials. 

Results 


The  median  integrated  error  scores  for  all  subjects  on  each  axis  are  shown  in  figures  5 
and  6.  The  scores  for  the  last  12  runs  of  the  fourth  day  (runs  73-84)  were  the  scores  considered 
in  the  analysis.  The  median  score  for  each  subject  in  both  groups  was  determined  and  the  median 
test  was  applied  to  these  scores.  The  results  were  significant  at  the  .05  level  of  confidence.  The 
exact  probability  by  Fisher's  method  was  0.007864. 


*  Circuit  for  one  axis,  including  switching,  is  shown  in  fig  8. 
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DISCUS-iaON  AND  CONCLUSIONS 


The  results  of  this  experiment  agree  with  the  results  predicted  by  the  Survey  of  Human 
Dynamics  Data  and  a  Sample  Application  (ref.  4).  While  the  optimum  dynamics  have  not  been  shown 
to  be  a  true  optimum,  when  the  subject  is  moderately  task  loaded  the  optimum  dynamics  have 
been  shown  to  be  definitely  superior  to  a  nearly  identical  set  of  dynamics  (figure  7).  The  optimum 
dynamics  were  derived  using  a  simplified  model  of  the  human  operator  and  a  minimum  rms  error 
criterion.  Basic  constraints  were  placed  on  the  form  which  the  dynamics  could  assume  and  a 
digital  computer  routine  was  prepared  to  search  for  the  parameter  values  which  would  optimize 
performance  in  terms  of  the  given  criterion  (ref.  4).  The  fact  that  the  results  of  the  present  study 
show  the  optimum  dynamics  to  be  clearly  superior  to  a  very  similar  set  of  dynamics  makes  it 
possible  to  place  considerable  confidence  in  the  use  of  a  simplified  model  of  the  operator  in  a 
tracking  loop  for  system  design.  Such  a  method  places  an  extremely  powerful  tool  in  the  hands  of 
the  applied  human  engineer. 

Use  of  the  operator  model  rather  than  human  subjects  allows  the  human  engineer  to  work 
directly  with  the  structures  and  flight  control  engineers  dealing  with  stability  and  control  early  in 
the  design  phase  of  a  system  rather  than  wait  until  a  design  is  frozen  and  only  the  cockpit  displays 
are  amenable  to  change.  Reference  1  gives  an  example  of  what  can  be  done  with  such  a  model  in 
system  design  utilizing  an  analog  computer.  Reference  3  gives  an  excellent  example  of  what  can  be 
done  analytically  using  the  transfer  function  model  of  the  pilot. 

The  major  purpose  of  the  experiments  described  in  the  present  report  was  to  lend  experi¬ 
mental  validation  to  some  of  the  predictions  that  have  been  made  using  the  model  of  the  pilot.  This 
has  been  done. 
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DISCUSS-SOM  AND  CONCLUdlONS 
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Dynamics  Data  and  a  Sample  Application  (ref.  4).  While  the  optimum  dynamics  have  not  been  shown 
to  be  a  true  optimum,  when  the  subject  is  moderately  task  loaded  the  optimum  dynamics  have 
been  shown  to  be  definitely  superior  to  a  nearly  identical  set  of  dynamics  (figure  7).  The  optimum 
dynamics  were  derived  using  a  simplified  model  of  the  human  operator  and  a  minimum  rms  error 
criterion.  Basic  constraints  were  placed  on  the  form  which  the  dynamics  could  assume  and  a 
digital  computer  routine  was  prepared  to  search  for  the  parameter  values  which  would  optimize 
performance  in  terms  of  the  given  criterion  (ref.  4).  The  fact  that  the  results  of  the  present  study 
show  the  optimum  dynamics  to  be  clearly  superior  to  a  very  similar  set  of  dynamics  makes  it 
possible  to  place  considerable  confidence  in  the  use  of  a  simplified  model  of  the  operator  in  a 
tracking  loop  for  system  design.  Such  a  method  places  an  extremely  powerful  tool  in  the  hands  of 
the  applied  human  engineer. 

Use  of  the  operator  model  rather  than  human  subjects  allows  the  human  engineer  to  work 
directly  with  the  structures  and  flight  control  engineers  dealing  with  stability  and  control  early  in 
the  design  phase  of  a  system  rather  than  wait  until  a  design  is  frozen  and  only  the  cockpit  displays 
are  amenable  to  change.  Reference  1  gives  an  example  of  what  can  be  done  with  such  a  model  in 
system  design  utilizing  an  analog  computer.  Reference  3  gives  an  excellent  example  of  what  can  be 
done  analytically  using  the  transfer  function  model  of  the  pilot. 

The  major  purpose  of  the  expieriments  described  in  the  present  report  was  to  lend  experi¬ 
mental  validation  to  some  of  the  predictions  that  have  been  made  using  the  model  of  the  pilot.  This 
has  been  done. 
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EXPERIMENT  I 


ANALYSIS  OF  VARIANCE 


Source 

df 

.SS 

MS 

F 

P 

Between  Subjects 

N-1  22 

4028.  40 

— 

-- 

-- 

Dynamics  (D) 

D-1  1 

45.  54 

45.  54 

0.240 

N.  S. 

Error  (b) 

N-D  21 

3982.  86 

189.66 

-- 

— 

'Within  Subjects 

N(R-1)115 

2070.80 

-- 

-- 

-- 

Runs  (R) 

R-1  5 

817.  83 

163.57 

14.113 

p  <.001 

D  X  R 

(D-1)  (R-1)  5 

36.05 

7.21 

0.622 

N.  S. 

Error  (w) 

(R-1)  (N-D)  105 

1216.92 

11.  59 

— 

-- 

Total 

RN-1  137 

6099.20 

t-TEST,  MEDIAN  TEST  AND  FISHER’S  P 


t-Test 

Optimum  Dynamics  Simple  Integrator 


12 

=  11 

S= 

=  0. 58 

20.  44 

Y 

=  21.28 

=  0.993 

82.67 

=  70. 48 

D 

=  0.84 

t  =  -oc:r-  =  0.846 
Not  Significant  at  .  05  level 


Median  Test 


Combined  Median  for  Both  Groups 

20.0 

Above  Median 

Equal  or  Below  Median 

Optimum  Dynamics 

4 

8 

Simple  Integrator  j 

7 

4 

11 

12 

12 

11 


Not  significant  at  .  05  level 


Pexact 


li:  X  12'.  X  11'.  X  12'.  11'.  X  12'.  X  11'.  X  12'.  11 '.  x  12'.  x  11 '.  x  12'. 

23  '.  X  4 '.  X  7  X  4 '.  X  8 '.  +  23 '.  x  3  i  x  3  '.  x  8'.  x  9 '.  +  23 '.  x  2 '.  x  2 '.  x  9 '.  x  10  '. 


11 '.  X  12 '.  x  11 '.  X  12  '.  11 ;  X  12  '.  X  11 :  x  12 '. 

^  23 '.  X  1 :  X 1 :  X 10  '.  X 11'.  23 :  x  o :  x  o :  x  ii ;  x  12 : 


0. 1504 
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AMRL-TDR-62-150 


EXPERIMENT  R 

MEDIAN  TEST  AND  FISHER'S  P 


’  Median  Test 


Combined  Median  for  Both  Groups 


Horizontal  18 

Vertical  15.5 


HORIZONTAL 


VERTICAL 


Above  Equal  or  Below 

Median  Median 


Above  Equal  or  Below 

Median  Median 


Optimum 

Dynamics 

Simple 

Integrator 


3 

10 

13 

Optimum 

Dynamics 

3 

10 

13 

10 

3 

13 

Simple 

Integrator 

10 

3 

13 

13 

13 

26 

13 

13 

26 

In  Both  Cases  X* 


26  (13x3  -  lOxlOl  -  13)* 
13x13x13x13 


5.54 


Significant  at  .  05 


■^exact  “ 


13'.  X  13'.  X  13’.  x  13'. 

26 '.  X  3 :  X  3 :  X 10 :  x  lo : 


131  X  131  X  131  X  131 
261  X  21  X  21  X  111  X  111 


131  X  131  X  131  X  131 
261  X  1 1  X  1 1  12 1  X  12 1 


131x131x131x131 
261x01x01x131x131  “  -007864 
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